Entropy and Divergence Associated with Power Function and the Statistical Application
نویسندگان
چکیده
In statistical physics, Boltzmann-Shannon entropy provides good understanding for the equilibrium states of a number of phenomena. In statistics, the entropy corresponds to the maximum likelihood method, in which Kullback-Leibler divergence connects Boltzmann-Shannon entropy and the expected log-likelihood function. The maximum likelihood estimation has been supported for the optimal performance, which is known to be easily broken down in the presence of a small degree of model uncertainty. To deal with this problem, a new statistical method, closely related to Tsallis entropy, is proposed and shown to be robust for outliers, and we discuss a local learning property associated with the method.
منابع مشابه
Some Statistical Inferences on the Parameters of Records Weibull Distribution Using Entropy
In this paper, we discuss different estimators of the records Weibull distribution parameters and also we apply the Kullback-Leibler divergence of survival function method to estimate record Weibull parameters. Finally, these estimators have been compared using Monte Carlo simulation and suggested good estimators.
متن کاملSome statistical inferences on the upper record of Lomax distribution
In this paper, we investigate some inferential properties of the upper record Lomax distribution. Also, we will estimate the upper record of the Lomax distribution parameters using methods, Moment (MME), Maximum Likelihood (MLE), Kullback-Leibler Divergence of the Survival function (DLS) and Baysian. Finally, we will compare these methods using the Monte Carlo simulation.
متن کاملRobust Estimation in Linear Regression Model: the Density Power Divergence Approach
The minimum density power divergence method provides a robust estimate in the face of a situation where the dataset includes a number of outlier data. In this study, we introduce and use a robust minimum density power divergence estimator to estimate the parameters of the linear regression model and then with some numerical examples of linear regression model, we show the robustness of this est...
متن کاملA Goodness of Fit Test For Exponentiality Based on Lin-Wong Information
In this paper, we introduce a goodness of fit test for expo- nentiality based on Lin-Wong divergence measure. In order to estimate the divergence, we use a method similar to Vasicek’s method for estimat- ing the Shannon entropy. The critical values and the powers of the test are computed by Monte Carlo simulation. It is shown that the proposed test are competitive with other tests of exponentia...
متن کاملFactors Related to Cultural Divergence in the Social Values among Two Generations of Families in Tehran
Cultural divergence is incongruity in the values, attitudes and behaviors among different generations of a society. Identifying factors related to cultural divergence in the social values of parents and children is one of the most important issues in Iranian society, which has been investigated in the present research through a quantitative approach. The statistical population of the study co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Entropy
دوره 12 شماره
صفحات -
تاریخ انتشار 2010